Large Language Models (LLMs) currently struggle to sequentially add new memories and integrate new knowledge. These limitations contrast with the human ability to continuously learn from new experiences and acquire knowledge throughout life. Most existing approaches add memories either through large context windows or external memory buffers (e.g., Retrieval-Augmented Generation), and studies on knowledge injection rarely test scenarios resembling everyday life events. In this work, we introduce a continual learning framework, Memory Embedded in Gated LLMs (MEGa), which injects event memories directly into the weights of LLMs. Each memory is stored in a dedicated set of gated low-rank weights. During inference, a gating mechanism activates relevant memory weights by matching query embeddings to stored memory embeddings. This enables the model to both recall entire memories and answer related questions. On two datasets - fictional characters and Wikipedia events - MEGa outperforms baseline approaches in mitigating catastrophic forgetting. Our model draws inspiration from the complementary memory system of the human brain.

This fair usage agreement ("Agreement") is between CyberExtruder.com, Inc., a New York corporation with its principal office located at 1401 Valley Road, Wayne, New Jersey, 07470, USA ("Company") and the user of the Data Set, as defined below ("Licensee"). Whereas the Licensee is interested in the fair use of the Data Set for the non-commercial purposes of testing face recognition algorithms, and the Company wants to facilitate Licensee's testing of face recognition algorithms, the parties agree as follows: The Data Set contains 10,205 images of 1000 people collected randomly from the internet and is unrestricted with regard to the subject's pose, environmental lighting conditions, facial expression, subject's race and subject's age and contains images which are artistic impressions, drawings, paintings and other non-photographic representations of faces, and a multitude of facial occlusions like hats, glasses and makeup. All images are sized to 600 x 600 pixels and are stored with jpeg compression. LICENSE GRANT A non-exclusive, nontransferable, royalty-free license is granted to Licensee to use the Data Set on an appropriate computer system located at Licensee's premises. The Company is free, at its sole discretion, to distribute the Data Set to others and to use it for its own purposes.